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Abstract. For a word 5, let f{S) be the largest integer m such that there 
are two disjoints identical (scattered) subwords of length m. Let /(n, S) = 
min{/(S') : S is of length n, over alphabet E}. Here, it is shown that 

2/(n, {0, 1}) = n - o(n) 

using the regularity lemma for words. I.e., any binary word of length n can 
be split into two identical subwords (referred to as twins) and, perhaps, a 
remaining subword of length o(n). A similar result is proven for k identical 
subwords of a word over an alphabet with at most k letters. 
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1. Introduction 

Let S' = Si . . . s„ be a word of length n, i.e., a sequence si, S2, ■ ■ ■ , Sn- A (scat- 
tered) subword of S* is a word S" = Si-^Si^ . . .Si^, where ii < i2 < • ■ ■ < is- This 
notion was largely investigated in combinatorics on words and formal languages 
theory with special attention given to counting subword occurrences, different com- 
plexity questions, the problem of reconstructing a word from its subwords (see, e.g., 
[5, 10, 11]). For a word S, let f{S) be the largest integer m such that there are two 
disjoints identical subwords of S, each of length m. We call such subwords twins. 
For example, if = S1S2S3S4S5S6 = 001011, then S" = S1S5 and S2 = s^se are two 
identical subwords equal to 01. The question we are concerned with is "How large 
could the twins be in any word over a given alphabet?" One of the classical prob- 
lems related to this question is the problem of finding longest subsequence common 
to two given sequences, see for example [4, 7, 13]. Indeed, if we split a given word 
S into two subwords with the same number of elements and find a common to 
these two subwords word, it would correspond to disjoint identical subwords in S. 
Optimizing over all partitions gives largest twins. 

Denoting S" the set of words of length n over the alphabet S, let 

/(n,S) = min{/(5):5GS"}. 

Observe first, that /(n, {0, 1}) > [(l/3)nj. Indeed, consider any 5' S E" and split 
it into consecutive triples. Each triple has cither two zeros or two ones, so we can 
build a subword Si by choosing a repeated element from each triple, and similarly 
build a subword S2 by choosing the second repeated element from each triple. For 
example, if = 001 101 111 010 then there are twins 81,82, each equal to 1 1 0: 
5" = 001 101 111 010, here one word is marked bold, and the other marked red. 
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In fact, we can find much larger identical subwords in any binary word. Our 
main result is 

Theorem 1. There exists an absolute constant C such that 



In the proof we shall employ a classical density increment argument successfully 
applied in combinatorics and number theory, see e.g. the survey of Komlos and 
Simonovits [8] and some important applications [6] and [12]. We first show that 
we can partition any word S into consecutive factors that look as if they were 
random in a certain weak sense (we call them e-regular). These e-regular words 
can be partitioned (with the exception of e proportion of letters) into two identical 
subwords. By appending these together for every e-regular word, we eventually 
obtain identical subwords of roughly half the length of S. 

We generalize the notion of two identical subwords in words to a notion of k 
identical subwords. For a given word S, let f{S, k) be the largest m so that S 
contains k pairwise disjoint identical subwords of length m each. Finally, let 



In case when k is smaller than the size of the alphabet, we have the following 
bounds. 

Theorem 3. For any integer k >2, and alphabet S, \T,\ > k, 



where a G [0, 1/fc] is the solution of the equation i -'^^"a '^"(1 — ka)^°' ^ = 1, 
whenever such solution exists and otherwise. 

We shall sometimes refer to two disjoint identical subwords as twins, three dis- 
joint identical subwords as triplets, k disjoint identical subwords as k-tuplets. We 
shall prove the regularity lemma for binary words in Section 2 and will prove the 
Theorem 1 in Section 3. We shall prove Theorems 2, 3 in Section 4. We shall ignore 
any divisibility issues as these will not affect our arguments. 



First, we shall introduce some notations (for more detail, see for instance [2, 9]). 
An alphabet S is a finite non-empty set of symbols called letters. For a (scattered) 
subword S' = Si-^Si^ . . . Sj^ , of a word 5, we call the set {zi, ^2, • ■ • 7 ««} a support 
of S' in S, and write supp(S"), so the length of S' , \S'\ = |supp(S")|. Denoting 
/ = {ii, . . . ,is}, we write S' ~ A factor of is a subword with consecutive 

elements of S, i.e., SiSi^i . . . Si+m, for some 1 < i < n and < m < n — i, we denote 
it S[i,i + m]. If 5 is a word over alphabet E and g G S, we denote \S\q the number 
of elements of S equal to q. The density dq{S) is defined to be jS'l^/IS'l. 




/(n, k, E) = min{/(5, fc) : 5 G E"}. 
Theorem 2. For any integer k >2, and alphabet E, |E| < k, 





2. Definitions and Regularity Lemma for Words 
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For two subwords S' and S" of S, we say that S" is contained in S" if supp(S") C 
supp(S"'), we also denote by S' n S" a subword of S, S'[supp(S") n supp(S"')]. If 
S = si . . . Sn and S[l, i] — A, S[i + l,n] ~ B, then we write S = AB and call S a 
concatenation of A and B. 

Definition 4 (e- regular word). Call a word S of length n over an alphabet S 
e-rcgular if for every i, en + l<i<n — 2sn + 1 and every q G E it holds that 

\dg{S)-dg{S[t,i + en-l])\<e. (1) 

Notice that in the case = |{0, 1}| =2, do{S) = 1 - di{S) and thus \do{S) ~ 
do{S[i,i + en-l])\ < e \di{S) - di{S[i,i + en - 1])\ < e. When E = {0, 1}, we 
shaU denote d{S) = di{S). 

The notion of e-regular words resembles the notion of pseudorandom (quasiran- 
dom) word, see [3]. However, these two notions are quite different. A word that 
consists of alternating Os and Is is e-regular but not pseudorandom. Also, unlike 
in the case of stronger notions of pseudorandomness, one can check in a linear time 
whether a word is e-regular, cf. [1] in the graph case. 

Definition 5. We call S := {Si, . . . , St) a partition of S if S = S1S2 ■ ■ ■ St, (S is 
concatenation of consecutive Sis). A partition S is an e-regular partition of a word 
5 € E" if 

\S^\ < en, 

lelt] 

Si is not regular 

i.e., the total length of e-irregular subwords is at most en. 

The decomposition lemma we are going to show states the following: 

Theorem 6 (Regularity Lemma for Words). For every e > and to there is an 

uq and Tq such that any word S € E", for n > uq admits an e-regular partition of 

1 / ^ 

S into Si, . . . , St with to < t < Tq. In fact, Tq < to3 and uq = to£^^ 

To prove the regularity lemma, we introduce the notion of an index and a re- 
finement and prove a few basic facts. 

Definition 7 (Index of a partition). Let S :~ {Si, . . . , St) be a partition of S ^ E" 
into consecutive factors. Wc dehnc 

ind(5) = ^^d,(5.)2^. 

96i:iG[t] 

Further, for convenience we set indq(iS) = Yl,ie[t\ '^g('^i)^'^- 

Observe that ind(iS) is bounded by 1 from above. 
Definition 8 (Refinement of S). Let S = {Si, . . . , St) and 

be partitions of S" e E". We say that S' refines S and write S' =4 S, if for every 

i = 1, . . . ,t, Si = S[iS[2 ■ • ' ^i,Si ■ 

Lemma 9. Let S and S' he partitions of S £Tj^ If S' ^ S then 

ind(5') > ind(5). 
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Proof. Let 5= {Si,..., St) and 

C/ / Qf Qf Qf Qf Q/ Q/ Q/ Q/ Qf > 

~ Wl,!' "-"1,2' • ■ • ' '-'l,si ' "-"2,11 '-'2,21 • • ■ 1 "-"2,32' •■■) "-"t,!! '-'t,2i ■ • ■ ' '-'t,st^ 

Wc proceed for each g e S as foUows: 

S'es' 

i=l 3 = 1 



n 

i=i ]=i 



\S,. 



2 

Jensen's inequality , — , \.^ \ I \S^- ■ 



1=1 \]=i I 



2 

jig Pi,j| 



\ ^ \Si\ I I'S'i'.jlg IS*; 

* IS,' 



■^-^ n 

i=l 

= mdq{S). 

Now, building the sum over aU q G S yields: 

ind(5') > ind(5). 

□ 



The next lemma shows that if a word S is not e-rcgular, then there is a refinement 
of (5) whose index exceeds the index of (5) by at least e'^. 

Lemma 10. Let S G be an e-irregular word. Then there is a partition (A, B, C) 
of S such that \A\, \B\, \C\ > em and 

ind((A, B, C)) > ind((5)) + = d^iSf^ + (2) 

Proof. Since S is not e-regular, there exists an element g G S and an i with em+1 < 
i < m — 2em + 1 such that \d — d{S[i,i + em — 1])| > e, where d dq{S) and 
d{T) dq{T) for any factor T of S. Assume w.l.o.g. that d — d{S[i, i + em — 1]) > £ 
and set 7 d — d{S[i, i + em — 1]), A := S'[l, i — 1], B := S[i, i + em — 1] and 
C := S[i + em, m], a := \A\, b :— \B\ = em and c := |C|. 
Observe further that 



\S\q ^ diA)a + diB)b + diC)c ^ dm, d{{A,C)) = d{B)^d~j. 
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Since a + c = to - 6 and mdq{{A, B, C)) = mdq{{A, C, B)), 
mdg{{A,B,C))>diiA,C)f^+d{By ^ 



TO 



dm — (d — ^)b\ a + c ,,6 



a+c J m TO 

-f ^^ ^ («-7) — 

(to — ojm TO 

^— [d2(„i2 - to6) + 7'(™6)] 

(to — OjTO '■ ■' 
,9 7^^ ,9 ,9 ^ 

' ' > d^ + — > d^ + 



m — b (1 — e)m 

The case when d — d{S[i, i + sn — 1]) < — e works out similarly. Indeed, set 7 :— 
d — d{S[i,i + em — 1]) as before and notice that I7I > s and all the computations 
above are exactly the same. 

So, mdq{{A, B,C)) > d^ + e^. For aU other q' G S, Lemma 9 gives that 
indq'((A,B,C)) > ind,'((S')) = ^(S'). Thus 

mdiiA,B,C)) ^mdqiiA,B,C))+ ^^^^q' HA B , C)) > dq' (S)^ + 

□ 

Finally we are in position to finish the argument. 

Proof of the Regularity Lemma for Words. Take £ > and to as given. We will 
give a bound on no later. Suppose that we have a word S G S". Split it into to 
consecutive factors Si, . . . , Stg of the same length If 5 := {Si, . . . , Stg) is not an 
e-regular partition, then let / C [to] be the set of all indices such that, for every i G /, 
Si is not e-regular (thus, ^ Then, by Lemma 10, we can refine each 

Si, i G /, into factors Ai, Bi and Ci such that ind{{Ai,Bi,Ci)) > J2q<£i: dq{Si)^ + 
(in the case that (1) is violated for several <? G S, choose an arbitrary such q). We 
perform such refinement for each Si, i £ I, obtaining a partition S' ^ S, noticing 
that 

ind(5') = E E dq{S,r^-^ + 

tjes iei 



= E E dqis,r\^+j2ind{{A,B,,a))\^ 

96SjG[to]\/ is/ 

>E E rf,(^.f^+EM(^))+-^)v 



= ind(5) + £ 
> ind(5) + 
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Thus, S' refines S and has higher index. If S' is not an e-regular partition of S, 
then we can repeat the procedure above by refining S' etc. Recall that an index of 
any partition S is bounded from above by 1. Thus, since the increment of the index 
that we get at each step is at least and each word in the partition decreases in 
length by a factor of at most e at each step, it follows that we can perform at most 
many steps so that the resulting factors are non-trivial, and therefore wc will 
eventually find an e-regular partition of S. Notice that such a partition consists of 

at most 3 '"^ to words, since at each iteration each of the words is partitioned into 

1 / ^ 

at most 3 new ones. Therefore, Tq < 3 <o and each factor in the partition has 
length at least tQ^s^^^ n. □ 

3. Proof of Theorem 1. 

Before we prove our main theorem about binary words, we show a useful claim 
about twins in e-regular words. 

Claim 11. If S is an e-regular word, then 2/(5') > \S\ — SejS'l. 

Proof. Let \S\ = m. We partition S into t = 1/e consecutive factors Si,. . . , S'l/e, 
each of length em. Since S is e-regular, \d{Si)~d{S)\ < e, for every z e {2, . . . , 1/e — 
1}. Thus each Si has at least {d{S) — e)eTO occurrences of Is and at least (1 — 
d{S) — e)em occurrences of Os. Let Si{l) be a subword of Si consisting of exactly 
{d{S) — e)em letters 1 and Si{Q) be a subword of Si consisting of exactly (1 — 
d{S) — e)em letters 0. Consider the following two disjoint subwords of S": A = 
^2(1)^3(0)^4(1) •■•5t_2(l) and B = ^3(1)^4(0)55(1) ■'••5t-2(0)5t_i(l). When t 
is odd, A and B arc constructed similarly. 

We see that A and B together have at least m — 2e^m(l/e — 3) — 3em elements, 
where 2e^m(l/e — 3) is an upper bound on the number of Os and Is which we had 
to "throw away" to obtain exactly {d{S) — e)em letters 1 and (1 — d{S) — e)em 
letters in each Si, 2em is the number of elements in Si and St, and em is the 
upper bound on |52(0)| + |S't_i(l)|. Thus, 2f{S) > m — 5em. This concludes the 
proof of the claim. □ 

Notice that wc could slightly improve on 5em above by finding in an already 
mentioned way twins of size em/ 3 each in Si and St, but this does not give great 
improvement. 

Proof of Theorem 1. Let n be at least no, which is as asserted by the Regularity 
Lemma for words for given e > and to := \-~\. Furthermore, let S* be a binary 
word of length n. Again, Theorem 6 asserts an e-regular partition of S into Si, . . . , 
St with 1/e < i < To- We apply Claim 11 to every e-regular factor Si. Furthermore, 
since SiS appear consecutively in S, we can put the twins from each of SiS together 
obtaining twins for the whole word S. This way we see: 

2/(5) > J2 {\S;\ - 5e\S,\) > n - ben - en = n - Gen, 

jG[t] 
Si is £— regular 

here en corresponds to the total lengths of not e-regular factors. Choosing e = 
^( log'iogra )^^^"^' and an appropriate C, we see that n > e^^ . Therefore, by 
Theorem 6 2/(n, {0, 1}) > (1 - C(log n)-^'^))n. 

Next we shall prove the upper bound on f{n, {0, 1}) by constructing a binary 
word S such that 2/(5') < \S\ - log IS"]. Let S = SuSk-i ...So, where |5,| = 3\ S^ 
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consists only of Is for even i, and it consists only of Os for odd is. I.e., S is built of 
iterated 1- or 0-blocks exponentially decreasing in size. Let A and B be twins in S. 
Assume first that A and B have the same number of elements in Sk- Since Sk has 
odd number of elements, and A, B restricted to S" = Sk-iSk-2 ■ ■ ■ Sq are twins, by 
induction we have that \A\ + \B\ < (|5fc| + -logC-S"!)) = |S'|-l-log(|S"|) < 
151 - log That is true since \Sk\ = 3^ l^l = (S'^'+i - l)/2. 

Now assume, w.l.o.g. that A has more elements in Sk than B in Sk- Then B has 
no element in Sk~i- We have that \A n Sk~i\ > |S'fc_i|/2, otherwise \A\ + \B\ < 
\S\ - \Sk-i\/2 < \S\-log\S\. So, s = \AnSk-i\ > \Sk^i\/2 > 3'=-V2, and s 
elements of B must be in Sk-3 U Sk-5 ■■■ ■ But {Sksl + \Sk-5 \ + • • • < S''-^/2, a 
contradiction proving Theorem 1. □ 

Remark 12. One can find words of length n/2 — o{n) as described above by an 
algorithm with 0{e^'*'\Q\n) steps. 

4. fc-TUPLETS OVER ALPHABET OF AT MOST k LETTERS 

Proof of Theorem 2. As before, we concentrate first on e-regular words. Let S be 
an e-regular word of length m over alphabet E = {0, 1} and recall the 

assumption £ < k. We partition S in t — 1/e consecutive factors 5*1,. .. , ^i/^, each 
of length em. Since S is e-regular, \dq{Si)—dq{S)\ < e, for every i £ {2, . . . , 1/e — 1}, 
and every (7 G E. Thus Si has at least {dq{S) — e)em letters q, for each g e E. 

We construct fc-tuplets Ai, . . . , Ak as follows. Each of AjS consists of consecutive 
blocks, with first block consisting of {do{S) — e)em letters 0, followed by a block of 
{di{S) — e)em letters 1, . . . , followed by a block of {di-i{S) — e)em letters € — 1, 
followed by a block of {dQ{S) — e)£m letters 0, and so on. 

Since fc > |E|, we will use all but at most i£^m|E| + (2|E|)£TO = 3|E|em elements, 
where the first summand accounts for the number of elements that we did not use 
when choosing exactly {dq{S) — e)em elements q from each Si and each g G E and 
the second summand for the number of elements in Si, . . . , Si, and from S'i/£_£-|_i, 
. . . , Si/^. 

Below are the examples in the special cases when |E| = £ = fc and when |E| = 2 
and fc = 4. 
Example 1. 

Ai - 52(0)53(1)54(2) • • ■ 5,+i(£ - l)5,+2(0)5,+3(l) • • • S2i+i{i - 1) ■ • • , 

A2 = 53(0)54(1)55(2) • • • 5,+2(^ - l)5f+3(0)5,+4(l) ■ • ■ S2l+2{i - 1) • ■ • , 

A, = 5,+i(0)5,+2(l)5,+3(2) • • • 5,+£(£ - l)5,+£+i(0)5,+,+2(l) • • • 5,+2£(^ - 1) • • • 
Ak^ 

Example 2. 

Ai 
A2 
A3 
Aa 



5f+i(0)5f+2(l)5,+3(2) ■ • • S2i{£ - l)52£+i(0) • ■ • 53^(^ - 1) ■ • ■ 

= 52(0)53(1) 56(0)57(1)- •■ 

53(0)54(1) 57(0)58(1) •■• 

54(0)55(1) 58(0)59(1)- •• 

55(0)56(1) 59(0)5io(l)--- 
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Here Si{j) is the block of {dj{S) — e)em letters j taken from Si. So, in general, 
the total number of elements in Ai,. . . , Afc is at least m — 3|S|em. Thus, kf{S) > 
m ~ 3|I]|em. 

To provide the lower bound on /(n, fc, E) we proceed as in the proof of Theorem 
1 by first finding a regular partition of a given word and then applying the above 
construction to regular factors with an appropriate choice of e. □ 

5. Large alphabets and small fc-xuPLExs 

Proof of Theorem 3. The proof of the lower bound proceeds by considering a scat- 
tered word W consisting of the k most frequent letters. Clearly, \W\ > j^ri, which 
together with Theorem 2 yields the lower bound. 

The upper bound we obtain is either immediate from Theorem 1 or from com- 
puting the expected number of fc-tuplets of length m each in a random word of 
length n over an alphabet S of size £. If the expectation if less than 1, this means 
that there is a word S with f{S, fc) < m. Indeed, there are 

^ fe-i 



n — im 
m 



distinct sets of fc disjoint subwords each of length m in a word of length n. The 
probability that such a set corresponds to a fc-tuplet, when each letter is chosen 
with probability 1/i independently, is Thus, the expected number of fc- 

tuplets is at most 



^(l-fc)r 



n 

that is, for m 



n — im 
m 



{m\)^{n — km)\ 



m''™{n — fcm)' 



^—[k—l)an 



an, is at most 



(an)'=«"(n - fcan)"-'="" 

Thus, if - fca)'"""^ is less than 1 then f{S, fc) < an. In particular, 

for fc = 2 and £ = 5 one can compute that a < 0.49. □ 



6. Concluding Remarks 



E\n 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


{0,1} 


2 


2 


2 


3 


3 


4 


4 


5 


5 


5 


6 


6 


{0,1,2} 


1 


1 


2 


2 


2 


3 


3 


3 


4 


4 


4 


4 





18 


19 


20 


21 


22 


23 


24 


{0,1} 


7 


7 


8 










{0,1,2} 


< 5 


< 6 


< 6 


< 7 


< 7 


< 8 


< 8 



Table 1. Values for smah t of f{t, 2, 2) and f{t, 2, 3). 



6.1. Small values of f{n,k,Y,). We will slightly abuse notation and denote by 
f{n,k,£) the value of f{n,k,T,) with = £. In the introductory section it was 
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observed that /(3, 2, 2) = 1 yielding immediately a weak lower bound on /(n, 2, 2) 
to be [JT-ZSJ. In general, it holds clearly 

f{n,k,£)> [^\ f{m,k,£). 

For example, we determined (Theorem 3) a lower bound on /(n, 2, 3) to be ^n—o{n). 
Wc do not know whether it is tight and, more sadly, whether one can achieve it, 
without o(n) term, by finding a (reasonable) number t such that /(t, 2, 3) > |- If 
one could find such t this would immediately give another proof of f{n, 2, 3) > ^n — 
t. However, the smallest value for such possible t could be 21, which already presents 
a computationally challenging task. In the tables above we summarize estimates on 
the values on f(n,k,£), which were determined with the help of a computer. Thus, 
the first "open" case which might improve lower bound on /(n, 2, 3) is /(22, 2, 3). 

6.2. Improving the O (^ '"i^g"^" ^ ^ n term. Further we remark, that a 

more careful analysis below of the increment argument in the proof of Theorem 6 
leads to the bound Tq < to3^^^^°^^''^'^ , which in turn improves the bounds in 
Theorems 1 and 2 to 

Jj_C|E|(<!2il2il£)''')„<./(„,.,E). 

Recall that in the proof of Theorem 6 we set up an index and refining a cor- 
responding partition each time we increase it by at least e^. Let's reconsider jth 
refinement step at which the partition S = {Si, . . . , Stg) is to be refined. Further 
recall that / consists of the indices i such that Si is not e-regular. Let aj be such 
that 

^\S,\=ajn. (3) 

iei 

In the original proof we iterate as long as aj > s holds. And by peforming an 
iteration step we merely use the fact that aj > e which leads to increase of the 
index during one iteration step. Recall that ind(iS) was defined as follows: 



ind(5) = E E ^«(^^)' 



n 

<jGEje[|5|] 

and for each further refinement S' ^ S it holds: 

ind(5)<ind(5') = ^^^^ind(5i) + ^ind(52)<y V d„(S',f^ + a,, 

qe^3e[\s\]\i 

(4) 

where Si consists of e- regular words from 5(thcsc words are not partitioned/refined 
anymore) and 52 consists of not e-regular words from S (and their lengths sum up 
to aju). 

Let £ be the total number of iteration steps until we arrive at an e-regular 
partition. Let ai, . . . , ai be the numbers, where ajU is the sum over the lengths 
of not e-rcgular words in the partition at step j, j € [£] (cf.(3)). 

By the discussion above 

1 > ai > a2 > ■ ■ ■ > ai > e. 
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Next, we partition (e, 1] into logj ^ consecutive intervals {yi+i,yi\ where yi = 1 
and yi+i = yi/2. We claim that each interval {yi+i,yi] contains at most ^ ajs. 
Indeed, the increase of the index during step j where aj € {yi+i,yi] is at least 

a^e^ > yi+ie^. 

Further, let j' be the smallest index such that aj' < yi and j" be the largest index 
such that aj" > Hi+i- Let indj be the index before the jt\\ refinement step. Then 
by (4) the following holds for j' + 1 < j < j": 

indj/+i < indj < indj" < indj'+i + yi. 

This implies that the number of a^s in the interval (y^+i, yi] cannot be bigger than 

y^ ^ 1 

yi+ie^ ' 

Thus, we obtain the following upper bound on £ 

2 logp i 

which leads to Tq < to3^-'^^°^'''>/^\ uq = toe^^'^^"^^/''^^^'' and thus we can regularize 

V log " / 
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